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1.  Introduction* 

A  matrix  A  with  components  a„  ,  i,j  *  l,2,...,h,  [written 
A  =  (a^)]  is  called  a  Toeplitz  matrix  if  a ^  -  a^_ j  •  A  particular 
case  is  when  a. .  =  ai .  .  i  . 

iJ  I  i-J  I 

In  mathematical  statistics  Toeplitz  matrices  arise  in  several 
contexts;  see,  for  example,  Grenander  and  SzegG  [8].  Consider  the 
following  frequently  occurring  case.  Let  {xfc:  t  =  ...,-1,0,1,...} 
be  a  wide-sense  stationary  stochastic  process  with  <£xt  =  0  for  all 
t.  Its  covariance  sequence  satisfies 

(1.1)  px  x  =  CovCx^jX  )  =  ai  |  ,  s,t  =  ...,-1,0,1,. 

t  s  t  s  s-t  ’ 


*The  author  acknowledges  financial  assistance  from  the  Ford  Foundation 
and  leave  from  the  University  of  Tucumdn,  Argentina. 
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that  is  ,  a  function  of  j  s— t  ]  only.  If  x  =  (Xp...,x^,)'  is  a  finite 
segment  of  {Xj.},  then  its  covariance  matrix  is  the  T  x  T  matrix 


is  a  matrix  of  Toeplitz  type. 

It  is  important  to  note  that  Z  can  also  be  viewed  as 


(1.3) 


T-l 

~T  =  J ^  °k5k 
k*=0 


where  G, 

~k 


(g(k)) 


and 


(1.4) 


-  0, 


1 1-3  I  =  k, 

1 1-3  I  $  k. 


is  a  linear  combination  of  simple  known  matrices  Gp  =  I, 
Gp».i»G^_^,  the  coefficients  being  the  parameters  o^.  This  structure 
has  been  exploited  to  find-  the  maximum  likelihood  estimators  of  the 
c^'s  under  normality;  see,  for  example,  Anderson  [1],  [2],  [4],  and 
references  therein.  Here  we  shall  be  concerned  with  finding  the 
inverse  of  1^,,  and  it  turns  out  that  the  linear  structure  can  be 


2 


used  to  devise  a  practical  procedure  for  such  purpose.  For  a  solution 
of  a  similar  problem,  with  different  Ch  ' s,  see  Mustafi  [11]. 

It  must  be  pointed  out  at  the  outset  that  there  exists  wide 
interest  in  finding  either  exact  or  approximate  values  for  the  components 
of  such  inverse  matrices,  since  that  knowledge  can  be  used  to  derive 
the  statistical  theory  for  procedures  defined  in  terms  of  them.  For 
example,  the  author's  interest  in  the  inverse  analyzed  in  Sections 
2,  4,5  and  6  stems  from  the  study  of  Walker's  [16]  estimation  pro¬ 
cedure  for  the  moving-average  time-series  model. 

In  many  cases  the  underlying  assumptions  imply  that 

(1.5)  =0,  | i— j |  >  m, 

where  m  is  a  nonnegative  integer.  We  may  call  these  processes 
"finitely  correlated  of  order  m".  The  case  of  lack  of  correlation 
corresponds  to  m  =  0.  If  m  <  T-l,  then  E^  has  m  diagonals 
above  and  m  below  the  main  diagonal  with  (possibly)  nonzero  components, 
and  all  other  components  are  zero.  For  some  of  these  matrices  the 
inverse  is  known.  When  m  =  1,  Shaman  [12],  [13]  gave  several  forms 
of  the  exact  inverse,  and  several  approximations.  One  of  the  methods 
in  his  paper  is  extended  in  Section  2  to  the  case  m  =  2. 

In  Section  3  a  different  approach  is  used  for  the  particular 
case  E^,  =  I  +  pG^,  and  a  new  expression  for  the  exact  inverse,  and 
some  approximations,  are  presented.  The  method  is  then  applied  in 
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Section  4  to  invert  I  +  p^G-^  +  P2G2,  and  in  Section  5  to  the  general 
matrix  with  such  a  structure.  The  proposed  method  is  used  at  some 
points  in  conjunction  with  a  condition  that  is  stated  and  proved  in 
an  Appendix;  it  is  related  to  "diagonal  matrices  of  type  r"  '  (cf . 
Greenberg  and  Sarhan  [7]  and  others)  defined  by  the  tact  their  components 
satisfy  a_^  -  0  whenever  |i-jj  _>  r. 

Finally  Section  6  discusses  an  approximation  based  on  a  well- 
known  relation  between  autoregressive  and  moving- average  time  series. 

Since  for  Oq  4  0 


(1.6) 


m 


j=0 


m 

1  P«G« 


where  p^  =1;  Pj  =  aj/°o’  3  =  l>2,...,m,  we  see  that  there  is  no 
loss  of  generality  in  taking  the  coefficient  of  G^  in  (1.3)  to  be 
one,  as  will  be  done  below  whenever  it  is  convenient. 


4 


2. 


The  Inverse  of  I  +  +  P2?2  hy  evaluation  of  cofactors. 

Let  E,j,  =  (cr  „  )  =  I  +  +  P2G2,  P2  ^  0,  and 

-1  (T) 

^T  =  =  (w^  •  ) *  The  components  of  can  be  computed  from 


(2.1) 


w 


/m.  cofactor  of  0 . . 
(T)  _  _ _ ji_ 

13  '  l?Ti 


The  method  presented  in  this  section  consists  in  expressing  all  the 
determinants  that  may  appear  in  (2.1),  in  terms  of  some  determinants, 
like  | E  | ,  each  one  of  which  satisfies  a  certain  difference  equation. 

In  this  section  we  use  the  following  notation,  where  a  subscript 
denotes  the  order  of  the  corresponding  matrix  or  determinant,  and 
we  omit  the  superscripts  in  the  components  to  simplify  the  writing. 

We  also  use  the  notation  of  partitioned  matrices: 
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/ 


0  0  0 


Px  1 


P1  P2  ° 


P  2^ 


(2,4) 


0  0  0  0  0 
0  0  0  0  0 


0  0  0\ 

0  0  0 

0  0  0 


Pi  1  Pj 
p2  P!  1, 


P2  0  .  .  ,  0 


K  =  K  |  . 
s  1  ~s 


By  expanding  in  terms  of  the  components  in  its  first  row, 

Durbin  ([5],  p.  315)  found  that  the  determinants  satisfy  the  linear, 
homogeneous,  fifth-order  difference  equation 


(2.5)  -£n+(l  P2)In-l+<-p2~pl)En-2+p2(pl  p2)  En-3+p2  (p2  ^  En-4+p2En-5  “  °" 


The  associated  polynomial  equation 


(2.6) 


-z5+(l-p2) z^+(p2-p^) z3+p2 (p^-p2) z2+p3 (p2-l) z+p3 


can  be  written  in  a  symmetric  way  using  the  substitution  -p,>x  =  z5 
after  division  by  p3  we  obtain 


(2.7) 


2  2 

5  ,  1_P2  4  pl-p2  3  Pl“P2  2  ,  1_p2 

x  +  -  x  +  - r—  x  +  - 7T~  x  +  - 

P9  2  Po 

2  P2  P2  2 


x  +  1  = 
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Zero  is  not  a  root  of  (2.7),  and  if  x*  is  a  root  so  is  1/x*.  Since 
there  must  be  five  roots,  +1  or  -1  must  be  one  of  them.  (They 
are  the  only  "self  inverses".)  By  inspection  we  see  it  is  -1.  Then 
(2.7)  factors  as 


(2.8) 


0  =  (x+1)  (x-x^  (x  -  i-)(x-x2)(x  -  — ) 

=  (x+1) (x2-d^x+l) (x2-d2x+l) 

=  (x+1) [x^-(d1+d2)x3+(2+did2)x2-(d1+d2)x+l] 

=  x5  +  (l-di~d2) (x4+x)  +  (2+d1d2~d1-d2) (x3+x2)  +  1, 


where  d^^  =  x^  +  1/x^  i  =  1,2.  Equating  coefficients  in  (2.7)  and 
the  last  line  of  (2.8)  we  obtain 


(2.9) 


2+d1d2-d1-d2 


2 

P1  p2 


If  we  define 


(2.10) 


2p0-l 


2  2 
Pi ~2p0+2p„ 


u  = 


v  = 


then  (2.9)  can  be  written  as 


(2.11) 


d^fd2  =  u,  2+d^d2  =  v. 
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] 


This  system  has  solutions 


(2.12)  d1,d2  =  ± 


u  +  u u  +4 (2-v) 


2p, 


2p2-l  ±  J(2p2+l)2-4p^ 


and  another  pair  with  the  roles  of  d^  and  d2  interchanged.  Since 

2 

we  want  to  determine  the  roots  x„  from  x  -d.x+1  =0.  we  see  that 

3  i  ’ 

(2.12)  gives  rise  to  all  possible  different  roots.  They  are  given  by 


(2.13) 


1 

1  2  ' 

1 1 

1  I  2 

X1’X3  “  2 

dl  -  !dl-4j 

5  x2  >x4  =  2" 

d2  1  J  d2-4 

1 

Note  that.  x^x^  =  X2X4  =  We  conclude  that  the  roots  of  (2.7)  can  be 
labeled 


,  1  1 

i  r 

,2  ,\ 

i 

i 

f  ,  1  "2  ' 

X1  =  “1,  x2  ~  2*1 

ldi+f 

1 1 

,  x„  =  — , 

1  3  V 

x4  =  2 

:d2-^d2-4 

,  x„  =  — 
5  x. 


Substituting  back  z  =  -p2x,  (2.6)  has  the  following  roots: 


(2.15)  z^  =  p2,  z2  = 


~Pr 


Wl"4 


-2p, 


»  z3 


ll+fP 


z,  = 


z_  = 


p2  I 


d2+l/d2_4 


-2p, 


In  general  the  roots  (2.15)  can  be  real  or  complex,  and  some  or  all 
can  be  identical.  Hence  the  solution  of  (2.5)  will  take  different 
forms  depending  on  this  fact.  As  an  example,  which  will  be  also  used 
as  illustration  in  subsequent  derivations,  if  all  roots  are  distinct 


] 


then  (2.5)  has  solution 


(2.16) 


E  =  l  C.z?  , 
n  . L.  1  l 
1=1 


where  the  are  the  roots  given  in  (2.15). 

Since  E^  is  defined  only  for  n  >_  1,  (2  „ 5 )  holds  for  n  >_  6, 

and  the  sequence  satisfying  the  difference  equation  and  for  which 
(2.16)  is  the  general  solution  is  E^E^,...  .  The  boundary  conditions 
to  determine  Ch,  i  =  1,...,5,  can  be  taken  to  be  (2.16)  for 
n  =  1,...,5,  with  the  left-hand  sides  evaluated  explicitly  as 


=  1-Pi> 

(2.17)  =  (l-p2) (1+P2_2P^X> 

2  2  4  4  2  2  2 

^4  =  E3"(pl+P2)+(pl+p2)+2plp2"2':>lp2> 

E5  =  E4-p2E3+2p2p2(l-p2-p2+p2)-p2(l-p2-p2). 


Following  the  same  approach  we  expand  in  terms  of  the 

components  in  its  first  row  and  find  that 


(2.18) 


Ln  plLn-l  +  P2Ln-2 


plp2Ln-3  +  p2Ln-4  °' 


The  polynomial  equation  is 


(2.19) 


4 

y 


3  2 

-  pxy  +  p2y 


2  .  4 

-  PxP2y  +  p2 


=  o. 
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and  after  replacing  p2x  =  y  it  becomes 

,0  on\  44  33  32  3  4  n 

(2.20)  P2x  -  P±P2X  +  P2X  “  P]_P2K  +  P2  = 


which  has  symmetric  coefficients  and  can  be  studied  in  the  same  way 
as  equation  (2.7).  The  roots  y  ,  s  =  1,2, 3, 4,  of  (2.19)  are 
obtained  from 


(2,21)  d.  = 


2p, 


1  2  2) 

1  , 

1  12  2 

pl+|pr4p2+8p2  ’ 

d9  = 

2  2p2| 

pri(pr4p2+8p2 

l 

yl  =  2 


di+rr4 15 


2p, 


y2 


dlw’ 


y3 


p2; 


d9+ld  -4  ,  y,  = 


2p. 


d„+,  <tf-4 


The  particular  case  of  all  roots  distinct  leads  to  solving  (2.18) 
by  the  sequence 


(2.22) 


L 

n 


V  r  vn 
i=l 


n  =  1,2,... 


The  four  boundary  conditions  needed  to  determine  the  C  ’  s  can 
be  taken  to  be  (2.22)  for  n  =  1,2, 3, 4  with  the  left-hand  sides 
evaluated  explicitly  as 


(2.23) 


L1  =  pl' 

T  2 
L2  P1  p2  * 

3  2 

L3  =  p^+p2p^-2p^p2 , 

2  2  2 

b^  p  p 2  [  (p  P 2 ) —  p  2  (p  P  2  )  3  • 
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Expanding  by  the  components  in  its  first  row  we  have 


(2.24) 


K  =  Pi  E  ..-p0K  1 9 

n  1  n-1  2  n-1 


n  2,3,.., 


In  the  special  case  that  E^  is  given  by  (2.16), 


(2.25) 


k  +Pok  =  p,  y  c,z; 

n  p2  n-1  K1  t  l  l 
1=1 


n-1 


which  is  a  first-order,  inhomogeneous,  linear  difference  equation. 

The  complete  solution  is  the  sum  of  the  general  solution  of  the 
homogeneous  case  £ G ( — p ^ ) n ]  and  a  particular  solution  of  the  inhomo¬ 
geneous  case.  Provided  that  only  one  root  (for  ET)  equals  p2 , 


(2.26) 


Kn  =  6(-p2)n  +  \  P1C1  7-  p2  +  p 


5 

1  I 

j=2 


C. 

1 


Zj+p2 


The  second  summand  corresponds  to  the  root  zi  =  p2 »  no  o^er  z ^ 

can  be  equal  to  P 2  in  (2.26);  if  more  than  one  root  equals  p2, 

instead  of  the  factor  l/(2.+Pn)  we  have  to  use  l/2p_ . 

j  2  2 

The  new  constant  C  in  (2.26)  will  be  evaluated  from  (2.26)  for 
n  =  2,  with  =  p^.  Note  that 


K2  =P1(1-P2), 

(2.27)  K3  =  Px(l-pJ)  -  P1P2d-P2)» 

K4  =  P1^3  “  P2K3  =  pi (1-P2 ) (1+P2-2P1)  -  P2k3- 
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With  this  background  we  now  find  expressions  for  the  components 


Ulj  °f  »T  '  5t 


-1 


Since  W^  is  symmetric  we  restrict  attention  to 


the  components  on  and  above  the  main  diagonal. 

1st  case:  i  =  i.  Then  w. .  =  B../E„,  where  B..  is  the  cofactor 
— - **-  xi  11  T  11 

of  o..c  In  terms  of  submatrices 

li 


(2.28) 


B.  .  = 

li 


*' 


h-i  p2? 


p25  5T-i 


where  E*  has  its  upper  right-hand  element  equal  to  1  and  all  other 
elements  equal  to  zero.  We  use  Laplace's  expansion  in  terms  of  minors 
of  the  first  i  -  1  columns;  then 


(2.29) 


B.  . 

li 


Ei-lET-i“P2Ei-2ET-i-l* 


To  make  (2,29)  valid  for  all  i,  we  define  Eg  =  1,  E_^  =  0. 

2nd  case:  i  <  j. 


(2.30) 


(-l)i+V,  = 

ij 


~i-l 

P„E* 


j-i 
* 


p2e 


T-j 


where  F  has  its  lower  left-hand  element  equal  to  p^,  the  two 
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adjacent  elements  equal  to  p  ,  and  all  other  elements  equal  to  0. 

We  expand  (2.30)  by  Laplace's  formula  in  terms  of  minors  of  the  first 
i-1  columns.  In  these  columns  there  are  three  non-vanishing  minors 
with  non- zero  complementary  minors,  namely 


(2.31) 

I5i-.il  • 

=  Ei-J 

1 

1 

0 

(2.32) 

I.  -  1 

-1-2  1 

p 

P2 

1 

P1 

0  ......  0  j 

P2 

“  p2Ei-2> 


and 


=  P2Ki-2! 


(2.33)  j  K*_2  I  p2 

*  1 

0  ......  0  j  p2 

1  * 

*  i*i 

where  Kg  is  Kg  flipped  about  its  secondary  diagonal,  so  that  |  Kg  |  «=  K  . 
If  we  denote  by  Ag(i,j),  s  =  1,2,3,  the  corresponding  cofactors,  then 


(2.34)  (-l)i+jB  =  Ii_iA1(i,j)-p2Ii_2A2(i,j)+p2Ki_2A3(i,j) 


The  A  (i,j)’s  are  computed  using  Laplace's  expansion  in  terms  of 
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I 


the  last  T-j  columns 0  Then 


^ 2^T“ i — i” l"^”^ 2 ^ T“i “l^i “1  “2  5 

j  j  j  >j  j  j 

2  2 

^ (i* J  )  ^ T— j  i^ j _i_ ^”~P 2^3 *“ i"“2 ^ ~"*P 2^T~“ j  ^P  1^*3  —i“2 ~P 2 ^ j  —l—  3^ 

(2.35)  4.  /  T  .2  •  \ 

+P 2 ^T- j -1  1L j -i-3  P2  jj— i—4-  5 

A3(i,j)  «  P2ET-jLj-i-l-p2KT-jLj-i-2+p2ET-j-lLj-i-3' 


For  j  =  [T/ 2 ]+l , . . . ,T ,  say,  these  formulas  are  valid  for  all  i  <  j, 

provided  we  define  E_  =  L  '=  1,  K.n  =  0 ,  Z  =  L  =  K  =0  for 

u  0  0  -s  -s  -s 

s  >  0,  For  j  <  [T/2J+1  similar  arrangements  could  be  made.  In  fact, 
due  to  the  structure  of  WT  we  only  need  to  compute  those  components  of 
the  last  I(T+l)/2]  columns  on  and  between  the  principal  and  secondary 
diagonals,  and  then  deduce  the  remaining  components  using  the  symmetry 
of  WT  and  its  persymmetry  (symmetry  with  respect  to  its  secondary 
diagonal).  They  lead  for  example  to 


C2*36)  W-jj  wT-i+l,T-j+l  = 


i  =  j  =  1,2,...,  [T/2].  • 


We  summarize  these  results  as  follows: 


Proposition  2'.  1.  Let  XT  =  ^+pl~l+p2^2  ’  P3  ^  0,  and 

Z"1  -  WT  =  („g>  )  .  Then 


(2.37)  w<?  «  (-l)1+j  ,  i  =  j  , . . .  ,T-j+l;  j  =  [T/2]+l , .  ,  .  ,T, 

1 J 
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where  the  are  given  in  (2.29)  when  i  =  j  and  in  (2.34)  and 

(2  o 35)  when  i  <  j ,  in  terms  of  the  determinants  £  ,L  ,K  ,  which 
-  - - - - - - - - - - - -  s  s  s - 

are  defined  in  (2. 2)t(2 .4)  and,  satisfy  the  difference  equations  (2.5), 
(2.18)  and-' (2 .24)  ,  respectively.  The  remaining  elements  of  W  are 
obtained  using  =  Wji^  an^  (2.36). 

If  p2  =  0  but  Pl  j  0,  then  Lg  «  p®,  Ks  =  P1ES-1» = 


Zi_lAi(i,j),  A^(i,j)  =  p~^  ,  and  the  solution  reduces  to 


(2.38) 


w 


(T)  _  ,  D  ,3-i  £1-.1.ZTzJ. 
ij  Pl' 


which  is  of  form  given,  for  example,  by  Shaman  [12]. 

Hence,  in  principle  at  least,  this  method  gives  a  complete 
solution  to  the  problem  of  finding  £„,^.  For  large  T  the  computations 
involved  may  be  quite  laborious.  As  we  saw  in  (2.29)  the  components 
along  the  main  diagonal  are  functions  of  the  E  determinants  only; 
but  if  i  4  j ,  even  in  row  i  =  1  we  already  have  all  types  of 
determinants.  In  effect 


(2.39) 


ZTwll(-DJ+1  =  ET-iLi-rp2KT-iL1-2+p2ET-i-lLi-3’ 

J  J  sJ  J  sJ  d 


j  —  2,3,. . „ ,T . 
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3. 


The  inverse  of  I  +  pG^  by  solving  difference  equations. 

A  different  approach  will  now  be  used  to  find  E^  =  WT  in  the 
case  of  m  =  1 ,  that  is,  E^  =  I  +  pG^.  Of  course,  we  assume  p  ^  0. 
By  the  definition  of  an  inverse 

(3.1)  I  =  EtWt  =  (I.+  pG-^  =  W^pG^. 


In  terms  of  components  (3.1)  is 


(3.2) 

5il 

(3.3) 

5lj 

(3.4) 

6Tj 

pWT-l ,  j^Tj  s 

1  —  1,2,...,T;  i  —  2 ,3 , .  , .  ,T  1, 

j  =  1,2 . T  (i=l), 

j  =  1,2,. ...T  (i=T) , 


where  6..  is  Kronecker's  delta  function.  We  consider  the  solution 
il 

of  (3.2)  as  a  second-order,  linear  difference  equation  in  i,  for  each 
fixed  j;  that  is,  we  proceed  column  by  column.  The  associated 
polynomial  equation  is 


(3.5) 


2 

px 


+  x  +  p  =  0, 


which  has  roots 


(3.6) 


x. 


.  -l+Vl-4p 

2p 


X2 


-l-Vl-Ap' 

2p 


16 


For  any  p  ^  0,  xjx2  =  For  c°variance  matrices  we  further 
restrict  our  attention  to  the  case  [pj  <  h-  Hence  |x^j  <  1  and 

| ^2 1  >  1,  or  |x  |  >1  and  j  I  <  1.  We  choose  to  present  all 

results  as  functions  of  x^,  j x^  |  <  1. 

The  general  solution  of  (3.2)  in  the  homogeneous  case  is  then 

(3.7)  w_  =  A(j)x^+B(j)x1i. 


To  find  the  complete  solution  we  must  take 
can  be  done  for  example  by  expressing 
of  sines  and  cosines,  since  it  is  true  that 


6..  into  account.  This 
i  J 

as  a  linear  combination 


(3.8)  (6±j)  -  I  -  MM\ 

where  M  is  orthonormal.  See  Anderson  [3],  Section  4.2,2,  Instead 
of  this  direct  approach,  we  shall  use  (3.2)  only  when  6^^  =  0;  in 
particular  we  shall  restrict  attention  to  the  w^ j ' s  above  and  on  the 
main  diagonal. 

Let  us  consider  the  T-th  column  first.  Its  components  satisfy 


0  =  w1T  +  pw2T 

(row 

1), 

0  =  PW1T  +  W2T  +  pW3T 

o  a 

•  o 

(row 

e 

2), 

«  (i 

0  ~  pwT-2,T  +  WT-1,T  +  pwTT 

D 

(row 

H 

1 

J-4 

1  *  PWT-1,I  +  ”TX 

(row 

T). 
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The  equations  from  rows  2  through  T-l  have  as  solution  the  sequence 


(3.10)  wiT  =  A(T)x^+B(T)x“i,  i=l,2,...,T. 

The  equations  for  rows  1  and  T  will  be  used  as  boundary  conditions 
to  find  A  =  A(T)  and  B  =  B(T) : 


0  =  (AXj+Bx^)  +  p(Ax2+Bx^2) 

-2 

=  Ax^Cl+px^)  +  Bx1  (x^p) 

=  Axx(-  £-)  +  Bx12(-px^)  =  -p (A+B) , 

1  =  p  (Ax^  +Bx^  )  +  (Ax^+Bx^  ) 

=  Ax^_1(p+x1)  +  Bx^Cpx.j+l) 

r.  T+1l13  -(T+l), 

=  -p [Ax^  +Bx^  J . 


Hence 
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) 

! 

We  next  consider  the  (T-l)-st  column,  for  which  the  set  of 
equations  is 

(row  1)  , 
(row  2) , 

• 

* 

(row  T-2)  , 
(row  T-l) , 
(row  T) . 

I 


0  =  wi  t  i  +  P^2 

0  =  PW^  +  -^2  r[,  ^  +  pWg 

®  o 

0  O 

(3.13) 

0  =  pWj_2  ^  +  w>p_2  T-l  ^WT  1  T-l 

1  =  PW^_2  PWrp  ^_T 

0  =  PWr[,_J  rj,  ^  +  W,J, 


The  equations  in  rows  2  through  T-2  have  solution  w.  = 

l ,  l-l 

i  -i 

A(T-l)x^  +  B(T-l)x^  .  Row  1  provides  one  boundary  condition  and 
row  T-l  the  other,  provided  we  make  the  value  of  w^  explicit 

(Rows  2  through  T-2  involve  only  up  to  i  =  T-l.)  Since 

WT  is  symmetric,  this  is  achieved  by  letting  w,p  =  wT_^  T,  where 

WT-1  T  was  already  evaluated  in  column  T. 

In  this  manner  we  proceed  column  by  column  to  derive  a  general 
expression  for  w^ ,  i  £  j *  We  now  prove  that  for  s  =  0,1,..., T-3, 


(3.U)  w1>T_s 


l+x^+  +x^s 

1  °  1  (  T+l-s+i 

...  2T+2.  U1 

p(l“X1  ) 


T+l-s-i, 

x.  )  , 


i  <  T-s , 
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We  already  proved  that  (3.14)  holds  for  s  =  0  (j  =  T) .  Suppose 
it  holds  for  s(0  <  s  <  T-5,  say);  it  suffices  to  show  that  from 
this  assumption  we  can  show  it  holds  for  s  +  1. 

Column  T-s-1  gives  rise  to  the  equations 

Wf  "t  PW2  X— s— 1* 

pWi-l, T-s-1  +  Wi, T-s-1  +  pwi+l, T-s-1’  1  = 

PW„  Mm  -  +  Wm  1  rri  i  +  DW_  „  , 

T-s-z3T-s-1  T-s-1, T-S-1  i-s , 1-s-l 

and  other  equations  for  components  below  the  main  diagonal.  We  use 
the  first  and  third  lines  of  (3.15)  as  boundary  conditions  to 
determine  A(T-s-l)  and  B(T-s-l) ,  taking  wT_g  T_s_1  =  WT_S_1  T_s  = 
w  as  given  from  the  known  solution  of  column  T-s.  The  equations  are 


0  = 

(3.15)  0  = 

1  = 


(3.16) 


A(T-s-l)  +  B (T-s-1)  =  0  , 
A(T-s-l)xJ  S  +  B(T-s-1)x^T+S  =  w*  -  , 


and  the  solution  is 


(3.17) 
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Hence 


T-s 


x. 


1-xt 


1  (l-x2s+4)(l-x2T~2s)" 

■2s 

P  (1-x2) (l-x2T+2) 

iJ 

.  .  2^  .  2s+2 

l+xi+” ■ ”+xl  T-s 

„  2T+2,  X1 

p(l-x-  ) 


l\ 

I'1/ 


(3.18)  wijT_s_1 


1+X^K 


+x' 


2s+2 


2T+2. 

pCI-Xj^  ) 


(x 


T-s+i 


T-s-iv 

x,  )  , 


i  =  1,2  ,  „ .  . ,T-s-l, 


which  is  what  we  wanted  to  show. 

When  s  equals  T-l  or  T-2 ,  i.e.  when  we  deal  with  columns 
j  =  1  and  2,  the  system  (3.15)  does  not  hold  because  then  most 
of  the  components  in  the  column  are  below  the  main  diagonal.  Since 
WT  is  symmetric  with  respect  to  its  two  main  diagonals, 
from  the  components  in  columns  T,T-1,  etc.  we  can  deduce  those  in 
columns  1,2,  etc.,  respectively,  by  means  of  the  relations 


(3.19)  w±j.  Wj±  wx_i+1>T_j+1>  1,2,... , T . 


Substituting  j  -  T-s  in  (3.14),  and  (l-x2s+2) / (1-x2) 
2  2s 

1  +  x^  +. „ .+  x^  ,  we  have 
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Proposition  3  1.  Let  ?T  -  +  p?i>  P  ¥  0,  and 

=  W^,  =  (,<J> ) .  Let  x^  =  (l/2p)  (-l+\jl-4p2)  and  assume  that 
l-4p^  >  0.  Then 


(3.20) 


(T) 

w' 

ij 


1-x' 


2T-2 j+2 


/1  2.  .  2T+2. 

pCl-X^Cl-Xj^  ) 


(X' 


=  12  T" 


i  <  j 


Two  different  forms  of  this  formula  are  derived  in  the  Appendix 
using  a  different  argument. 

Shaman  [12]  gave  this  result  as 


w 


(T) 


(3.21) 


(-l)j  i[(-x1)"±-(-x1)i][(-x1)"T+j_1-(-x1)T^+1] 

V 1— 4p2  [(-x,)-1-1-^)^1] 

*1"T+j"1(1-xJT-2J+2)  (x^-xj) 


-T-l 


-  -  J,  /  2  2T+2. 

x,  yi-4p  (l-x1  ) 


p(l-x1) 


1-x 


2T-2 j+2 


^  \fl-4p2 J  p(l-x^) (l-x2T+2) 


(x 


J+1+i  _  xj+1_i 


L), 


which  agrees  with  (3.20)  because  the  quantity  inside  the  brackets 
equals  1. 

From  (3.20)  we  can  derive  some  approximations,  provided  |x^j  <  1 
and  T  is  large.  Taking  i  j  as  in  (3.20)  we  have 
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(3.22) 


wCT) 
w .  * 

ij 


(l_x21-2J+2)(jcJ+1+l-xJ+1-i) 


p(l-x2) 


for  any  j ; 


(3.23)  w 


j+l+i  j+l-i 

(T)  a  X1  X1 

1J  p(l-x^) 


for  j  small; 


(3.24) 


(T) 

w;  / 

ij 


(l-xf-2J+2)xf1-i 

p(l-x2) 


for  j  large. 


In  particular,  under  the  same  assumptions,  we  have  that  the 
following  approximations  are  very  good  for  columns  1  and  T: 


(3.25) 


(T) 


WiT 


T+l-i 


The  present  author  [10]  found  use  for  approximations  like  those 

in  (3.22)-(3o25)  in  developing  some  asymptotic  statistical  theory, 

T  2T 

since  the  omitted  parts  behave  like  x^  or  x^  ,  and  when  |x.J  <  1 
they  could  be  safely  neglected  for  limit  purposes. 

Shaman  [12]  gave  the  approximation 


(3.26) 


w 


(T)  (-l)^”1(-x1) 

ij  * 


j"i 


X' 


j+l-i 


i|l-4p2 


x1(l+2px1)  ’ 


all 


i  £  j 


based  on  a  different  argument. 
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4. 


The  inverse  of  I  +  +  p2§2  by  solving . difference  equations. 

We  now  apply  the  basic  idea  of  Section  3  to  the  case  m  =  2, 
that  is,  ®  I  +  +  p2G2,  P 2  ^  ~T  assumec^  positive 

definite,  but  otherwise  no  further  restrictions  are  placed  on  and 

P2 .  Then 

(4.D  i  -  etwt  -  wt+p1g1wt+p2g2wt  . 

In  terms  of  components  (4.1)  is,  for  all  j. 


(4.2) 

*u 

= 

Wlj+plW2j 

+p2w3j 

(i-1). 

(4.3) 

=  P.W, . 

1  lj 

+w„ ,+p_w„ . 

2j  1  3j 

+p2w4j 

(i=2)  , 

(4.4) 

hj 

l,j+wij+plwi+l,j 

+P2wi+2,j  » 

i=3,4 , . . . ,T-2  , 

(4.5) 

=  ^2WT  3  j^iwT 

2,j+WT-l,j+PlWTj 

(i-T-1) , 

(4.6) 

°Tj 

53  p2^r^1  2 

(i-T). 

We  plan  to  solve  the  equations  in  (4.2)-(4.6)  for  each  column 
(j  fixed)  to  find  the  components  of  W^,  above  the  main  diagonal. 
The  characteristic  equation  associated  with  the  fourth-order  linear 
difference  equation  (4.4)  is 

(4.7)  p2xVp1x3+x2+p1x+p2  =  0, 

or  dividing  through  by  p2(p2  ^  0) , 
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(4.8) 


4 


x 


3 


P1 

+  —  x  + 
P2 


1 


0. 


Since  (4.8)  is  symmetric  in  its  coefficients  it  can  be  treated  as 
equations  (2.7)  or  (2.20).  We  are  thus  led  to  find  the  roots  of 


(4.9) 


x2-d„x+l  -  0, 

l 


i  -  1,2, 


where  the  d^  satisfy  the  system 


(4.10) 


dl+d2 


2+dld2 


This  system  is  like  (2.11)  and  hence  has  solutions 


(4.11) 


and  the  four  roots  of  (4.7)  can  be  labeled  x^,  1/x^,  ^ ,  l/x^. 

If  the  roots  are  distinct,  the  solution  of  (4.4)  in  the  homogeneous 
case  is  given  by  the  sequence 


(4.12)  w  =  C* ( j ) x^+G^ ( j ) x~x+C* ( J ) X2+C^ ( j ) x” 1 ,  j=l  ,2 , . . .  ,T ;  i-1,2,... 


If  the  roots  are  real  and  either  x^  =  x^  or  x^  =  1 then  the 
solution  can  be  written  as 
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(4.13)  w_  =  [C1(j)+iC2(j)]x^+[C3(j)-t-iG4(j)3x11,  i,j  =  1,2,...,  T. 


For  the  sake  of  illustration  we  now  consider  the  evaluation  of 

the  constants  in  (4.13),  where  we  take  j x^ j  <  1.  This  case  arose 

^  2  2 

in  the  study  of  Walker’s  paper  [16],  with  p.  =  — - — p„  =  — - — — . 

l+2pZ  2  1+2 p 2 

See  Mentz  [10] 

The  components  in  column  T  of  satisfy  the  equations 


(4.14) 


0  = 
0  = 
0  = 
0  = 
1  = 


P1W1T 

2wi-2 , T 

p lwi- 1 , T 

2WT- 3 ,  T 

+ 

P  qwT_ 2 , T 

2wt-2 , T 

*+* 

P  xw,T- 1 ,  X 

p  j_W2T 

+ 

P2W3T 

(row  1), 

+  W2T  +  Pxw3x 

+ 

P2W4T 

(row  2) , 

+  wiT  +  Plw1+1.  T 

+ 

p2Wi+2,T’ 

x  —  3 , .  . . 

+  WT-1,T  +  P1WTT 

(row  T-l) 

+  WTT 

(row  T) . 

The  solution  of  the  difference  equation  for  rows  3,...,T-2  is  (4.13). 
We  can  use  the  equations  for  rows  1,2,T-1  and  T  as  boundary 
conditions  to  specify  the  =  C^(T),  h  =  1,2, 3, 4.  For  example  the 
first  equation  gives 


0  = 


(4.15) 


(C1+C2 ) x1+(C3+C4)x"1+p x (Cx+2 C2 ) x2+p  ± (G3+2G4) x32 

+P2(C1+3C2)x3+p2(C3+3C4)x“3 

2  3  2  3  -1  -2  -3 

=  C1(x1+p1x1+p2x1)+G2(x1+2p1x1+3p2x1)+C3(x1  +p]x1  +P2X1  ) 

+G4<‘Xl"L+2plxl2+3p2xl3^ 


Ciallt'G2a12+G3ai3+G4a14  * 
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say.  The  remaining  conditions  lead  to 


0  =  C1(p1x1+x^+p1x^+p2x^)+C2(p1x1+2x^+3p1x^+4p2x^) 

+C3^plxl1+xl2+plxl3+'32xl4-)+C4^plxl1+2xl2+3plxlJ+4p2xl4^ 


~  Cia21+C2a22+C3a23+C4a24  5 

(4.16)  0  -  C1x^(p2x^3+p1x"2+x^1+p1)+C2Tx^(^2x"34^1x^2H^X"1+p1) 

_  -T ,  3.  2 ,  .  N._  „  -T,T-3  3.T-2  2  T-l  ,  . 

^3^*1  ^  1  ^  T  ^ 2 Xl*  x”P lXl"^  T 

T  T  ( 0 )  -T  -T  (0) 

=  Clxia31+C2Txia32  +C3X1  a33+C4Txl  a34  ; 

,  „  T f  -2.  -1.,, m  T,T-2  -2.T-1  -l.,N 

1  =  C1X1^P2X1  +P1X1  +1)+C2Txi^_t_P2X1  h~x~P1x1  +1') 

-T  2  -T  T-2  2  T-l 

+C3x1  (p2x1+p1x1+l)+C4Tx1  (~Y~p2X1+  t~pixi+1) 

=  c  T  +c  r  T  (0)  -T  x  -Ta(0) 

-  Cixia41+C2r  1  42  +C3  1  a43+C4T  1  44  ° 


The  use  of  the  superscript  "(0)"  will  be  clarified  below.  If 
C(T)  »  (Cx(T) ,C2(T) ,C3(T) ,C4(T) ) *  is  the  vector  of  constants  for 
column  T,  then 


\a21 


C(T)  = 

(4.17) 


Ta(0)\ 
ia32  \ 

Ta(0) 
ia42  / 


^13 

a!4\ 

f 

jo\ 

\a23 

a2  V 

0 

-T 

/a33 

Ta(0)\ 

ia34 

0 

X1 

\f43 

Ta(°7 
a44  / 

W 
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"1 


where  u  =  (0,1)'  and  the  introduction  of  the  A.„'s  and  B  *s  is 

~ij  ~ij 

self-explanatory.  By  partitioned  inversion 


B  -  |X‘IA<0)-XTA(0)A‘1A  f1  -  xTk(0>-x2,A(0)A-1A  '_1 

~22  |  l  A22  ±~21  -11-12/  Xll^22  X1  -  ’  A^A 


-21  11-12 


(4.18) 


=  x. 


/  .  2T  (0) 

a33  +  X1  q33 


,  2T  (0) 
\a43  +  X1  q43 


TaC°)  +  2T  (0)\  1 

Ta34  +  1  q34  1 


Ta(0)  +  x2Tq(0) 
la44  1  q44 


where 


La(0)  ,  2T  (0) 
T  44  X1  q44 


21  (0) 
"a43  “  xi  q43 


,Ta(°)  _  2T  (0)\ 

-Ta_  XjL  q34 


34 


33 


,  2T  (0) 
+  X1  q33 


A„  = 


T'a33a44'-a 


(°)_a(°)a  ].2T/  a(°)+Ta(0)a(0)-Ta(0)n(0)-.  „<°> 

44  34  43/+  1  1  33q44  T  44  q33  T  34  q43  a43q34 


(4.19) 


I  4T  f(0)(0)  (0)  (0), 

+X1  q33  q44  -q43  q34  j  ’ 


and  (q|°^)  "  -^21<> -11^12°  Note  that  q^""  q,.  ^  for  some 


ij  ij 
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i 


that  depend  on  T  only  through 


'CO)  "CO) 

coefficients  q..  and  q„; 

expressions  like  (T-t)/T,  t  =  1,2,3.  Note  also  that 


(4.20)  B 


22  A, 


Ta 


(0) 

'44 


-Ta 


(0)\ 

34 


\a43  a33  / 


+  x 


2T 


‘44 


1(0)  (0)\ 

/o-  -q34  ' 

q33  / 


(0) 


\  q43 


Now 


■12 


“~11~12?22 


(4.21) 


_a_1a 
- 11-12 


(0) 

,Ta  v  ' 

44 

-<1 

2T.-1, 

1(0) 

q44 

(0)' 

q34 

a33  j 

X1  -11-12 

Lrt(°) 

(°) 

\  a43 

y  q43 

q33  / 

/b,(0) 

b,(0)\ 

/b"(0) 

b"(°)\ 

13 

°14 

,  2T 

°13 

°14 

1 

T 

b’(0) 

b'CO) 

lb"<0) 

b"(0:>) 

\  23 

24  / 

y  23 

b24  j 

say.  Hence  and  B^2  have  the  same  kind  of  structure.  Finally 

we  have  that 
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'(0) 
5 14 


+  b 


(4.22) 


C(T) 


'(0)  4-  V 

b24  +  b 


<  - < 


33 


"(0) 

2t\ 

'14 

Xl\ 

"(0) 

1 

2T 

'24 

X1 

<0) 

2T 

■34 

1 

(0) 

2T 

■33 

1  / 

and  this  completes  the  solution  of  (4.13)  for  column  T„ 

For  column  T-l  the  set  of  equations  is  obtained  from  (4.14)  by 
replacing  T  by  T-l  in  the  column  index  of  ,  and  interchanging 

0  with  1  in  the  left-hand  sides  of  rows  T-l  and  T.  All 
components  w^  i  -  1,2S.„„,T,  satisfy  the  homogeneous  difference 

equation  and  hence  the  last  two  equations  in  the  set  can  still  be 
used  as  boundary  conditions .  Hence 


,(0)  "(0)  2T\ 

13  13  1 


x. 


(4o23) 


C(T-l) 


b?(0)  +  b"(0)x2T 
23  23  1 


(0)  2T 

■a43  "  q43  X1 
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The  remaining  components  on  and  above  the  main  diagonal  can  be  found 
using  Proposition  A1  of  the  Appendix.  It  is  argued  there  that  in  the 
present  case  condition  (A.l)  can  be  replaced  by  an  equivalent  one 
relating  the  first  two  rows  to  each  of  the  remaining  ones.  The 
conditions  we  use  here  are 

(4.24)  eiiwlj+02iW2j  =  Wij ’  i  =  3 ,4 , . . .  ,T;  j  >  i, 

for  columns  j  =  IT/21+1,... ,  T;  cf .  Greenberg  and  Sarhan,  [7].  Then 
the  following  steps  will  provide  the  needed  components: 

Step  1.  Find  columns  T  and  T-l  of  W^,  from  (4.12),  (4.13),  or 
similar,  and  (4.22),  (4.23),  or  similar,  depending  upon  the  nature 
of  the  roots  of  (4.7); 

S tep  2 .  Using  (3.19)  deduce  rows  1  and  2  from  columns  T  and 
T-l. 

Step  3.  Determine  the  proportionality  constants  0_i.  in  (4.24), 

S  u 

from  columns  T  and  T~l; 

Step  4.  Using  repeatedly  (4,24),  find  those  components  w^  satisfying 
i  =  j,..o,T-j+l;  j  =  [T/2]+l , . . .  ,T-2 , 


Proposition  4.1.  Let  and  W^,  be  as  in  Proposition  2.1.  Then 

(T) 

the  w^ j  ' s  are  determined  by  means  of  the  procedure  consisting  of 
Steps  1  through  4  described  above,  together  with  (3,19). 
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Proposition  4-1  gives  a  constructive  way  to  obtain  £  \  We 

now  proceed  recursively  as  in  Section  3,  trying  to  gain  some  insight 

(T) 

into  the  final  form  of  the  ’s,  and  to  suggest  some  approximations. 

It  must  be  anticipated  that  for  this  case,  when  m  =  2,  it  was  not 
possible  to  obtain  a  closed,  explicit  expression  like  that  of  (3.20) 
when  m  =  1. 

From  the  solution  of  columns  T  and  T-l,  namely  (4.13) 
together  with  (4  22)  and  (4.23),  we  can  derive  sequentially  all 
columns  of  W_.  Consider  column  T-s,  for  s  =  2,3,...,T-5,  say. 

Its  components  satisfy  the  equations 


0 

0 

(4.25)° 

0 

1 


w 


1  ,T-s 


+plW2,T-s  +p2w3,T-s 


plwl,T-s 


(i“l) , 

'W,2, T-s  +pl”3.T-s  +p2”4,T-s  «-2>  • 

P2Wi-2  T-s  +plWi-l  T-s  "^i  T-s  +PlWi+l  T-s+P2wi+2  T-s’  i“3 , • • • ,T-s-2 
p2wT-s-3,T-s+plwT-s-2,T-s+WT-s-l,T-s+plwT-s,T-s+p2wT-s+l,T-s  (i=T-s-l) , 
p2WT-s-2,T-s+plwT-s-l,T-s+WT-s,T-s+plwT-s+l,T-s+p2wT-s+2 ,T-s  (1=T~s) > 


plus  other  homogeneous  equations  for  rows  i  >  T-s. 

The  solution  of  the  equations  in  rows  3  through  T-s-2  is 
given  by  the  sequence  (4.13)  for  j  =  T-s  and  i  =  1,2,..., T-s.  The 
equations  for  i  =  1,2  in  (4.25)  provide  two  boundary  conditions.  Using 
the  symmetry  of  W^  we  can  link  the  equations  for  rows  T-s-1  and  T-s 
with  the  components  in  columns  T-s+1  and  T-s+2,  which  we  take  as 
known,  by  letting  wT_s+ljT_s  =  wT_s>T_s+1  s  w*,  and  wT_s+2jT_s  = 
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Hence  the  boundary  conditions  are 


** 


=  WT-s,T-s+2  "  ws 


Wl,T-s  +p1W2}T-s+p2W3,T-s 


P lwl,T-s 


+w, 


2,  T-s 


(4.26) 
p2 

P2Wr[i  g  2  rjl  g"tp  J^Wrj,  g  -p  rjp  g  rp  g 


+plW3,T-s+p2W4,T-s 


P9W__  _  +P-.W-  r.  T  +WT  -  T  +P.W-,  _ 

^  X  S“* Jj  j  I^S  X  JL—S  Z  j  I- s  x  s—x ,  X~S  X  X“S  3  X— s 


0, 

o. 


~p2Ws’ 


=  i-Plw 


These  equations  can  be  solved  as  we  did  in  (4.15)-(4.23)  when 
s  =  0  and  1.  The  system  for  s  -  2s3,...,T-5  is 


(4.27) 

C(T-s) 


Uii  a12\ 


\a21  a22 


T-s 

ll 


(T-s)a, 


\a41  ^T_s)a/. 


/a, „  a. 


13  14 


a23  a24. 


(s)\ 
32  ' 

-T+s 

/a  33 

(X-s)a^> 

X1 

(s)i 
l42  / 

\a43 

_p2Ws 


^  & 
-plws-p2Ws 


(4.28) 


a<S>  - 
32 

a(s> 

34 

a(s) 

a42 

a(s) 

44 


0,1,0 0. 

,T-5, 

T-s-3 

-3  .  T-s-2  -2 

H 

1 

CD 

1 

M 

1 

H 

T-s 

P2X1  +^i“plXl 

T-s  X1 

T-s-3 

3 . ,  T-s-2  2  J 

T-s-1 

T-s 

P2X1  +  T-s  P1X1  + 

T-s  X1  +  p 

T-s-2 

-2  ,  T-s-1  -1 

T-s 

p2Xl  +  T-s  plXl 

+  1  , 

T-s-2 

2  ,  T-s-1 

T-s 

P2X1  +  “T=F"  p1x1  + 

1  . 
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By  an  argument  parallel  to  that  of  (4.17)-(4„23) ,  it  follows  that 


(4.29) 

C(T-s) 


T-s 


x. 


where 


ft.:?-) 


13 


14 


+  x! 


2 (T-s) 


K'(s)  '(s) 

[_\b23  24  / 


/(T-s)a^)  -(T-s)a^A 


b:cs)  b"(s)\ 


13 


14 


b"Cs)  b"(6) 


23 


'24 


-p2ws 


*  V 


*  ** 

'f-°lws-p2Ms  / 


\L\  -a43 


33  / 


+x 


2 (T-s) 


,<S>  -n(SA 

‘44  q34 


*  \ 


-p2ws 


W  (S)  (S)  .  2 

(T  s)  (a33a44  a34  ^3)  Xx 


2 (T-s) 


1  (s)  (q)  /  \  A  **J, 

\~q43  q33  /J  \1-plws-p2ws|/ 


(T  s)(a34  q43  a44  q33  ) 


(s)_.  ^S))l+x4(T-S)(q(S>q(S)-q(S)q(S)) 
;J™1  'q44  q33  q43  q34 


+  (a43q34  ~a33q44 


-A(®)A"1A 
-21  -11-12’ 


i»j  =  3,4, 


(4.30) 

/  '(s) 
b13 

=  -A_1 A 
-11-12 

/(T-s)a44) 

- 

(T-.)a<jA 

\b23S) 

^s)/ 

^  _a43 

a33 

\ 

-  -A-1 A 

~ 11-12 

f  '(s) 
q44 

9 

b24S)| 

1  _(s) 

\  q43 

4s) 

and  the  A.,  arise  from  (4.27). 
~  1  1 
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From  (4.29)  it  is  clear  that  we  can  justify  the  following: 


Proposition  4.2.  Let  and  be  as  in  Proposition  2.1.  Then 

(T) 

the  w^  's  •  have  the  form 


(4.31)  w$_s  =  (F1+iF2)x^  S‘1‘i+(F3+iF4;xJ"S  ^-(F^iF^xJ  (T_S)+i 


+(F7+iFg)xJ(T_S:)"1> 


s  =  2,...,T-5;  i  <  T-s , 


where  the  F^'s  depend  on  s  (column  index),  provided  equation  (4.7) 
has  roots  =  x2 ,  x^  =  x^  =  1/x^. 


Analogous  expressions  can  be  derived  for  other  patterns  of  roots. 
We  omit  those  details  here. 

For  many  purposes  it  appears  that  in  (4.22)  and  (4.23)  one  can 

2T 

discard  the  part  with  x^  as  a  factor,  and  further  approximate  Aq 
in  (4.19)  by  its  first  term.  Then 


(4.32)  C(T) 


T 

*1 


T/a  a(0)  a(0)a  ) 

T(  33  44  34  43} 


hTa 


14 

'(0) 

24 

(0) 


34 


1  *33 


,  C(T-l)  = 


Tfa  a(0)-a(0^a  } 

T(  33  44  34  43} 


’(0) 
b13 

,  ’(0) 

b23 


-a 


43 
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Further 


(s)  (s)  (s) 


for  T-s  reasonably  large,  a^2  ,  a^  ,  a^2  and  a 


.(s) 

44 


can 


be  taken  as  equal  for  all  relevant  s,  and  respectively  equal  to 


(4.33) 


-3 

-2 

-i 

l32 

"  P2X1 

4 

P1X1 

4 

xi 

4 

pi = 

a31’ 

3 

2 

l34 

P2X1 

4 

plXl 

4 

xi 

4 

pi = 

a33 9 

-2 

-1 

L42 

=  P2xx 

4 

P1X1 

4 

i 

a419 

l44 

2 

=  P2X1 

4 

P1X1 

4 

i 

= 

a43  • 

a,  <1  = 


Then  there  would  exist  more  similarity  between  (4.17)  and  (4.29) 
for  s  >  0,  and  the  computations  in  the  recursive  procedure  will  be 
simplified. 


36 


5 .  A  general  case. 

In  this  section  we  analyze  the  general  case 


(5.1) 


m 


1  j=0  3  J 


where  Gn  =  I,  prt  =  1,  p  f  0,  and  1  <  m  <  T. 

The  approach  of  Section  2  can  in  principle  be  attempted  to  find 
(T)  -1 

the  components  w^  of  .  By  a  careful  examination  one  can 

find  out  which  of  the  non-zero  minors  in  the  first  i-1  columns  of  the 

cofactor  of  a  have  non-zero  complementary  cofactors. 

We  observed  in  the  case  m  =  2  that  we  needed  three  classes  of 

determinants  satisfying  linear  difference  equations  of  orders  5,  4 

and  2,  respectively;  of  course  if  these  classes  could  all  be  reduced 

to  a  single  one  (say  the  E ^) ,  this  would  be  achieved  at  the  cost 

of  augmenting  the  order  of  the  difference  equations  involved.  Hence 

(T) 

in  general  we'  expect  complicated  expressions  for  the  w^  . 

The  approaches  of  Sections  3  and  4  seem  more  promising  to  find 
or  at  least  some  of  its  columns  (or  rows).  By  the  definition  of 


inverse 


(5.2) 


m 

y  W  =  Y  n  G  W  =  W+  )oGW 
~T~T  APj~j~T  ~f 


which  in  terms  of  components  is 
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Ij 

52j 


w 


ij 

pl"lj  w2  3 


+pf’2j 

+plw3j 


+"-+<VWl,j 

+*  ’  *+pmWmH-2,j  (1‘2>" 


(5.3) 


mj 


ij 


T-m+1, j 


pm-lwl/”  *  ^m-lj^mj  +plWm+l,j 

Pmwi-m,j+”  “  “+plwi-l,j+«ij  +plwi+l,j 


pmWT-2m+l,j+*  *  ’+plwT-m,  j^T-m+l ,  j+plwT-m+2  ,  j+ 


+‘”+pmw2m,j  (i=m)» 

i=m+l . 

(i=T-m+l) , 


+*  *  °+pmwi+m, j  *  i=m+1> 


*+P  ,W~. 

m-1  Tj 


Tj 


P  w  +• 

m  T-m,  j 


•+pl»T_iij+»TJ 


(i=T) . 


This  system  will  be  solved  for  each  j  (fixed  column)  and  i  <_  j ,  that 
is,  for  components  above  and  on  the  main  diagonal. 

The  linear  difference  equation  of  order  2m  corresponding  to 
rows  m+l,...,T-m,  in  the  homogeneous  case,  has  the  associated 
characteristic  equation 


(5.4) 


—  2m  j  n  2  m—  1  ,  . 

0  =  p  z  +p  z  +. . o+p 
m  m-1  m 

,  2m.,.,  ,  .2 m-1.  .  ,  ,  ,  m+1,  m-1.  ,  m 

=  p  (z  +l)+p  ,  (z  +z)+»»'+p,(z  +z  )+z  , 

m  m-1  1 


which  is  symmetric  in  its  coefficients.  Dividing  through  by 

p  (p  ^  0)  we  have 
mVKm 


(5.5) 


0  =  (z2m+l)  + 


m-l/_2m-l 


-(z 


m 


..  .  ,  ,  m-1  m+1.  1 

+z)  +• « •+  — (z  +z  )  +  — 

P  '  Pm 

m  m 


m 


T-m, 
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The  roots  of  (5 *5)  occur  in  pairs,  z^  and  1/z ^  (z ^  4  0) .  Hence 

(5.5)  equals 


2m  m  m 

(5.6)  0  =  n  (z~z  )  =  n  (z-z.)(z  -  — )  =  n  (z  -zd.+l), 

3=1  J  3=1  3  zj  j=l  3 


where 


(5.7)  d  «  z.  +  — , 

J  i 


Vj + 1  -  °- 


3  =  1 »2 , . 


or 


(5.8) 


3 


1,2 


)  o  o 


9  in  o 


Equating  coefficients  between  (5.5)  and  (5-6)  we  are  left 
system  of  nonlinear  equations  to  be  solved  for  the  d^'s. 
found  they  are  given  by  (4.10)  when  m  =  2;  when  m  =  3 


with  a 
We  already 
they  are 


(5.9) 


dl+d2+d3, 

3+d^d2+d^d2+d2d2» 

2d^+2d2+2d2+d^d2d2. 
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In  general  we  will  have  m  nonlinear  equations  to  be  solved  for 
d  , ...,d  .  Even  when  the  order  of  the  difference  equation  is  2m, 
the  system  is  of  order  m.  The  system  and  (5.8)  will  furnish  the 
2m  roots  of  (5.4),  say,  zi ,l/zq » • ♦ • > zm>l/zm* 

!  The  procedure  can  be  viewed  in  another  equivalent  formulation. 
(5.5)  is  equal  to 


0  .  i-  z  +  f  (z”+h+zm-h) 
"  ”  h-i  % 


(5.10) 


m 


z  +  z”  V  rh(z2h+l) 
pm  m  til  pm 


2  2 

Let  us  substitute  s  «*  z+l/ z  =  (z  +l)/z,  i.e.,  zs  =  z  +1.  Then 


n  n  /  2  _  \ n  2n , .  i  2  .  2(n  2 )  ( _  ^  .  .n .  n 
z  s  «  (z  +1)  =  z  +l+nz  [z  +!]+•••+(  )z  , 


if  n  =  2r 


(5.11) 


„2n  n  2r  2 (n-2)  ,  ,,n.  n-1,.  2 

z  +l+nz  [z  +!]+•• *+(r)z  (z  +1),  if  n  = 


and  after  successive  substitutions 


(5.12) 


z2n+l  =  zn(sn+Cn2sn_2  +•••), 


for  some  coefficients  .  Using  (5.12)  we  see  that  (5 . 10)  becomes 


2r+T , 
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'  m  p,  2h,  ' 

0  =  zm  i-  +  T  -5— ±1 

-Pm  h=l  Pm  z 


(5  o 13) 


m 


=  z 


"  !H(sh+r  s»-2+...) 

«  ^  n  h2 


9„  ,  P„ 

m  h=l  m 


—  Sm  +  .  .  •+  (—  +0  .  .  ) 

Pm  Pm 

m  m 


where  z  ^  0.  For  full  details  see  Anderson  [4]. 

Hence  we  have  reduced  the  problem  of  solving  (5,4),  which  is  a 
polynomial  equation  of  order  2m  (in  z) ,  to  that  of  solving 
(5.13),  which  has  also  a  polynomial  equation  (in  s),  but  of  order 
m.  Once  are  available,  the  roots  of  (5.4)  are  given  by 


(5.14) 


l  “  1,2,...,  in 


If  z, ,zn  , . . .  ,z  are  distinct,  then 
12m 


(5.15) 


w 


(T)  _ 
ij 


m 

Y 

L 

h=l 


ch(j>zh+ch<3)zh11 


i  1  j. 


The  form  (5,15)  will  have  to  be  altered  if  some  of  the  z^’s  coincide 

(T) 

The  2m  constants  in  the  final  expression  for  w.  .  can  be 

il 

evaluated  from  boundary  conditions  extracted  from  (5.3),  for  each  j. 
In  particular  for  columns  l,2,...,m  and  T-m+l,...,T,  the  boundary 
conditions  are  just  the  first  m  and  last  m  equations  in  (53);  in 
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fact  one-  of  the  resulting  linear  systems  will  determine  the  constants 
for  all  columns. 

To  determine  the  rest  of  the  components,  say,  above  and  on  the 
main  diagonal,  we  can  use  the  two.  approaches  introduced  in  Section  4: 
the  procedure  involving  the  result  stated  in  the  Appendix,  and  the 
recursive  procedure  that  works  column  by  column., 

Application  of  the  result  in  the  Appendix  leads  to: 


Proposition  5;.  T.  Let  be  given  by  (5.1),  with  =  I,  pn  =  1, 


J0 


-1  fT\ 

and  #  0,  1  _<  m  <  T,  and  let  £T  =  WT  =  (w^  ').  Then  the 

(T) 

,w)j  '  s  are  determined- by  means,  of  •  a  procedure  consisting  of  the 
following-  four-  steps : 


Step  1  Find  columns  T-m+1,  „ .  ,T  o_f  WT  from  (5.15)  or  similar 
expressions*,  depending  upon  the  nature  of1  the  roots  of  (5.4)  ,  where 


the  2m  constants  are;  evaluated  from  boundary  conditions  provided 
by  the'  first'  m  and  last  m  equations  in  (5.3); 

Step  2.  Using  (3.19)  deduce  rows  1,2,...  ,m,  f  rom  columns 
T-m+1 T ; 


Step  3.  Determine  the- proportionality  constants  0  in 


(5.16) 


0-  .,w^TV0„  .wlT)+»  -  ‘+&  w.o 

li  lj  2i  2j  mi  mj  ij 


i  =  m+1, . . . ,T; 


3  1  i. 


(for  columns  j=[T/2]+l, . . . ,T-m)  from  columns  T-m+1, ... ,T; 


42 


Step  4,  Using  repeatedly  (5.16)  find  those  components  w^  satisfying 
i  =  j,...,T-j+l;  j  =  [T/2]+l, . .  ,T-m,  and  all  others  using  (3.19). 


The  application  of  the  "column  by  column"  procedure  can  be 
summarized  as  follows: 


Proposition  5.2.,  Under  the  same  hypotheses  of  Proposition  5.1,  the 
(T) 

wij  fog  1  <_  j  are  given  by  (5.15)  or  similar  expressions,  depending 
upon  the  nature  of  the  roots  of  (5.4).  The  2m  constants  are 
evaluated  from  boundary  conditions  extracted  from  the  system  (5.3),  as 
follows:  '  For  columns  T ,T-1, „ . . rT-m+l,  the  conditions  are  the  first 
m  and  last  m  equations  in  (5.3) ;  for  columns  j  =  T-m,T-m-l, . . „ , [T/2]+l, 
say,  we  assume  that  columns  j+1 , j+2 , . . » , j+m  are  already  available, 
and  then  the  conditions  are  the  first  m  equations,  plus  equations  for 
rows  j -m+1 , . - . , j  with  the  substitutions 


(5.17) 


w 

w 


(T) 

(T) 

* 

3+1,3 

=  w.  . 

J  >3+1 

=  W-  „ , 

13 

(T) 

(T) 

* 

3+2,3 

=  W.  o,0 

3  >3+2 

=  w2  j  ’ 

(T)  (T) 

w„ ,  .  =  w,  „ ,  =  w  . 

3+m>3  3  >3+m  mj 


the  remaining1  columns  can  be  obtained  using  (3 . 19 )  by  symmetry  of 
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To  prove  Proposition  5.1  one  only  notes  that  (5.16)  is  equivalent 
to  the  condition  of  Proposition  A.l  in  the  Appendix;  see  comments 
there „ 

To  prove  Proposition  5.2  we  note  that  for  column  j,  [T/2]+l<j<T-m, 
the  complete  system  of  equations  is  composed  of  the  first  m  in  (5.3), 
plus  the  homogeneous  equations 


(5.18) 


m 

"n+  ■  °- 


i  -  m+l,iiH-2,, 


.3-m> 


plus  equations 


0  •  pmwj-2nt+l,  j+'  *  4+pXwj-mj  j^j-ra+i ,  j+plwJ-m+2  ,  j"1”*  °  °+Pmw j+1,  j  (1‘3 


(5  o  19) 


0 

1 


P _W;  „  1  "  0+P,W.  r.  ,+W„  <  j,  +P,’ 

m  j-m-l,j  rl  j-2 , j  j-l,j  K1 


w 


jj 


+°°°+p  w„.  -  „  (i=j 

m  j+m-l , j  J 


^+30*+PiW^  ,+tf, 


J _ YV  t  _  o 

m  j-m,j 


'  T  w  £  1  O  i  W  .  o 

1  j-l»3  jj 


+PlWi_LT  »  +co*+p  W„.  ..  '  (i=j 

1  j+l»J  rn  j+m,j  J 


plus  other  (homogeneous)  equations  for  rows  i  >  The  sequence 
satisfying  (5.18)  is  w^  ,  i  =  so  that  the  components  in 

the  left-hand  sides  of  (5.17)  have  to  be  obtained  from  the  columns 
already  determined. 

Note  1.  To  avoid  vacuous  statements,  T  is  taken  to  be  large  enough 
compared  with  m, 

Note  2  e  In  Proposition  5  .2  the  equation  for  row  j  is  inhomogeneous, 
and  all  other  are  homogeneous  (i.e.,  6^  =  0). 


-m+1) , 

-1), 

>. 
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Note  3.  In  some  particular  instances  the  procedures  described  in 


Propositions  5 . 
expression  for 


1  or  5.2  or  both  will  disclose  an  explicit  general 
(T) 

,  i  £  j,  as  was  exemplified  in  Section  3. 
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6;'  ~  An  approximation , 


Suppose  £  is  T  x  T  of  Toeplitz  type  with  components  or-  , 

!  i-J  I 

that  satisfy  (1.5)  for  some  m,  1  m  <  T-l.  Further  suppose  that 

Oq,o^, . . . ,Om,0,0, . . .  are  the  covariances  of  a  stationary  process 

(that  is,  a  covariance  matrix  of  any  order  with  these  elements  is 

positive  semi  definite).  Then  one  can  always  find  coefficients 

.,a  such  that  £  =  £.,.  ,  the  covariance  matrix  of  a  vector 
0  1m  ~  -MA 

(x^,„.»,x,p  of-  random  variables  generated  by  the  "moving-average 
model" 


(6.1) 


x. 


Vt  +  “iEt-i  +• 


°+  a  e.  , 

m  t-nr 


t  =  •  ,-1,0,1, . . 


2 

where  the  e^’s  are  independent ,  |et  =  0,  =  1,  for  all  t. 

See,  for  example,  Anderson  [3],  Chapter  5. 

This  way  of  'looking  at  £  gives  rise  to  a  different  approxi- 

-1 

mation  for  £  that  is  frequently  used,  at  least  for  small  values 
of  m,  and  that  we  now  discuss  in  the  general  case.  It  consists  in 


(6.2) 


where  £^  is  the  covariance  matrix  of  (y^ , .  . .  ,y,j,)  generated  by 
the  "autoregression" 


(6.3) 


O't  +  Vt-1  +' 


ay.  =  e.  , 

m  t-m  t 


■1,0,1, . . . 
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1 


where  the  e^'s  have  the  properties  of  those  of  (6.1) . 

Let  ~MA  =  [aMA(i’j)]  =  [aMA(i_j)]’  l~AR  =  [aAR(i>J)]  =  [aAR(i_j)] 
The  autoregressive  covariances  satisfy  the  Yule-Walker  equations 


m 


m 


(6.4)  J  “r^AR^-3^  =  ^ >  I!  ar0AR^ s-r)  =  s  ~  1,2  , ; 

r=0  r=0 


if  the  roots  x^,...,xm  of  the  polynomial  equation 


(6.5) 


M(x)  =  aAxm  +  a.  xm  ^  +•  •  •+  a  =  0 
0  1  m 


are  different,  then 


(6.6) 


m 


aAR<h>  *  ^ Vs’ 

S=1 


h  =  1,2 ,3, . . . , 


and  the  constants  K  are  determined  from  the  first  m  equations  in 
(6.4),  namely 


1  ■  VaR(0)  ’  '+  “n-l0AR(-m+1)  +  VaR^  > 


(6.7)  0  =  VAR(1)  +  ’”  +  01™-  iaAn(-m+2>  +  amCAD(-m+1). 


'm-lAR 


m  AR 


0  "  “0OAR(m_1>  +  -"  +  “m-laAR<0)  +  Var'-1’  > 


together  with 
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(6,8) 


0AR<-h)  '  °AR<h,! 


h  1,2 , .  „  „  , in , 


-1  (T) 

see  Anderson  [3],  Chapter  5»  Hence  if  =  (w ) ) ,  then 


(6.9)  w 


(T) 

ij 


m 


m 


oAEu.i)  -  I  kV-1  -  -  -1 


S“1 


s  s 


“  1  K  (J)x“  , 


S  =  1 


s  s 


3  ±  i. 


*  1 

where  K  (j)  =  K  xJ  is  constant  along  columns  of  E.  .  We  want  to 
s  s  s  ~AK 


compare  (6,9)  with  the  exact  form  (5,15),  that  is,  with 


(6  o 10) 


w 


(T)_ 
ij 


aMA<°> 


m  , 

s=l 


j  >  i; 


here  the  z  are  taken  to  be  distinct,  and  they,  together  with  their 
s 

reciprocals,  are  the  2m  roots  of  (5,4),  that  we  now  write  as 

0  "  aMA(m)z2ra  +  ‘°°+  °MA(m) 

(6.11)  =  zm[OMA(m)2m  +•••+  aMA(m)z_m) 

mf  /kVh 

“  z  L  aMA(h)Z  » 


because  =  aMA^-^ »  since  no  root  equals  zero,  this  shows  that 

z,.,,,,z  ,1/z, , . . „ ,1/z  are  also  the  2m  roots  of 
Is  ’  m*  1’  s  m 

m  h 

(6,12)  0  -  l  am(  h)zno 

h--m 
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The  key  fact  to  interpret  the  approximation  is  the  relation 


m  v.  -1 

(6.13)  l  °MA(h)z  =  M(z)M(z~  ), 

h=-m 

taken  from  Anderson  [3],  Section  5.7.  It  asserts  that  the  expression 

in  z  in  the  left-hand  side  of  (6.13),  formed  by  the  covariances  of 

the  moving-average  model,  admits  a  factorization  in  terms  of  polynomials 

in  z  and  z  \  each  formed  by  the  coefficients  of  the  model. 

If  in  the  approximation  (6.9)  we  choose  all  roots  x  to  be 

s 

less  than  one  in  absolute  value,  which  without  loss  of  generality  we 
can  always  do  when  dealing  with  second-order  moments,  it  then  appears 
that  the  approximation  (6.9)  consists  in  omitting  from  the  exact 
expression  (6.10)  the  part  involving  positive  powers  of  those  roots. 

The  constants  in  (6.9)  and  (6.10)  are  related  in  a  similar 
fashion:  the  m  equations  in  (6.7)  bear  to  those  in  (5.19)  to  be 
used  for  columns  not  near  the  end  points,  the  same  type  of  relation 
that  M(z)  bears  to  M(z)M(z  );  further  the  m  boundary  conditions 
provided  by  rows  i  =l,2,...,m  of  (5.3)  to  determine  the  Cg  and 

t 

Cg,  constitute  an  "end  effect"  that  is  neglected  as  part  of  the 
approximating  process.  The  first  assertion  follows  because  (5.19)  is 
also  expressible  as 


(6.14) 


)  0..A(r)w.  ,  „  =  o,,.  (0) , 

L  MA  1-s+r,-]  MA 
r=-m  J  ,J 

-  0, 


s  =  0, 

s  1,2,...,  m-  _L , 
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while  (6,7)  is 


(6.15) 


m 

£.VAR(s-r>  ' 

r=0 

-  o, 


s  =  0, 

s  =  1,2,... ,m-l; 


writing  (6.13)  as 


(6.16) 


m 

l  °MA(r)zr  = 

r=-m 


/  m 


r-0 


V 


s-r' 


m 


a 


-s+r' 


r’-O 


the  relation  follows  by  identifying  w^_g+r  ^  with  z  in  the  left- 

hand  side,  and  a  (s-r)  with  zs  r  in  the  right-hand  side,  for  each 
AK 

s.  Further  (6.8)  can  be  taken  to  correspond  to  (5.17) 

As  an  illustration,  when  m  =  1,  =  1  and  =  a,  (6.10) 

becomes 


(6.17) 


w 


<T)  _  Mil  i 

“  l+a2  1 


+  Mi ) 
2 

l+a 


I  2  2 

where  x^  =  (l/2p) (-1+ Vl-4p  ),  p  =  a/(l+a  ),  and  hence  x^  =  -a. 
From  (3,20) 


(6.18)  A(J)  =  -B(j) 


2T+2-21 .  j+1 
(l-x1  J)x^ 

~7  2  e  2T+2. 

p(l-x1)(l-x1  ) 


=  -xJ 


2W_  2T+2-2  j. 

(l+xx)  (1-^  J) 

^“7  277  2  T+2  7  ’ 

(1— x.^  (l-x1  ) 
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so  that 


(6.19) 


w 


(T) 

ij 


1-x 


2T+2-2J 


1^- 

-x. 


1-x 


2T+2 


(x^-x11) , 


j 


>  i„ 


For  the  first-order  autoregression  y  +  ayt_^  =  et,  the  covariance 

x  2 

sequence  is  o^(r)  =  (-a)  /(1-a  ),  so  that 


(6.20)  w 


(T)  ~  (-a) 
ij 


J-i 


1-a 


1-x 


2  X1 


=  K(j)x 


-l 


3  1  i- 


Hence  in  this  case  it  is  verified  that  the  term  containing  xjj"  is 
neglected,  and  the  "end  effect"  consists  in  taking  (l-x2T+2  2^) /(l-x2T+2) 
as  approximately  equal  to  one  in  the  coefficient  of  x^. 

When  m  =  2 ,  if  (6.5)  has  roots  x^  f  then  a^R(r)  is 

given  by  Anderson  [3],  page  174,  and 


(6.21) 


CD  ~  _ 

W.  =  0 


X 


j-i+1  j-i+1 


XT, 


AR 


(j-i)  - 


(x1-x2)(l-x1x2)  1  2 


j  1  is 


i-x: 


which  is  of  the  form  (6.9). 

Another  approach  that  is  often  used  to  analyze  the  approximations, 
is  to  relate  2^  to  2^;  see  e.g.  Durbin  [5].  For  m  =  1, 

01q  =  1,  Olj^  =  Oi, 
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(6,22) 


E"1 

~AR 


1  a 


a  1+a 


0  0 


0  0  0 


o\ 


0  0 


1+a  a 


which  differs  from  ‘  E^  in  that  the  components  in  places  i  =  j  =  1 

2 

and  i  =  j  *  T  are  1  instead  of  1+a  »  For  m  =  2,  =  1, 


c  •  • 


(6,23)  E^ 


1+a^  al+ai0t2  “2 
2  2 

ai+aia2  l+a^+c^  a-j+a.^^ 


•  o  • 


0 

0 

0 


0 

0 

0 


0 

0 

0 


0 

0 

0 


0 

0 

0 


6  6© 


.  a^+a^a2  1+a^ 


V 


0) 

0 

0 


2  2 

l+a^+c^  a^+a.^  a„ 


which  differs  from  E^  in  that  the  components  along  the  main  diagonal 

2  2 

should  all  be  1  +  +  a^,  and  along  the  two  adjacent  diagonals  should 

be  a  +  aj_a2  ■  The  f°rms  °f  for  different  values  of  m  were 


given  by  Siddiqui  [14]  and  Wise  [17]. 
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For  any  m,  there  are  differences  between  those  components  in 
two  submatrices  of  order  m  x  m,  located  at  both  end  points  of  ehe 
main  diagonal. 
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APPENDIX 


On  a  necessary  and  sufficient  condition  for  a  covariance  matrix  to 
have  an  inverse  of  diagonal  type.  In  this  appendix  we  state  and  prove 
in  detail  a  result  that  appears  to  have  originated  with  Guttman  [9J 
and  Ukita  [15 j.  The  conditions  were  used  by  Greenberg  and  Sarhan  [7], 
who  call  them  sufficient  conditions. 

A  matrix  A  =  (a^j)  is  said  to  be  "diagonal  of  type  r"  if 
aij  =  ®  whenever  j i- j j  r.  From  (1.5)  it  follows  that  a  stochastic 

process  which  is  finitely  correlated  of  order  m,  gives  rise  to 
covariance  matrices  which  are  diagonal  of  type  r  =  m+1. 


Proposition  A.l.  Let  I  =  (c^ )  be  a  T  x  T  symmetric  and  positive 


,-l 


definite  matrix.  A  necessary  and  sufficient  condition  that  Z  =  (w_^  ) 
be  diagonal  of  type  r  is  that  there  exist  constants  b  such  that 

-  - - £g  - - - 

for  t  =  1 ,2 , . . . ,T-r+l 


(A.l) 


°tt'  ^  btl°t+l,t'  +' *'+  bt,r-l°t+r-l,t'  0>  tf  t+1>-*->T- 


Proof.  For  the  necessity  of  the  condition,  suppose  that 
y  =  (y1, . . .  ,y,r)  '  is  a  vector  of  jointly  distributed  random  variables 
with  =  0  and  covariance  matrix  E  such  that  E-b  is  diagonal 

of  type  r.  There  exists  an  upper  triangular  matrix  B  =  (b^)  with 
b.,  =  1,  and  a  diagonal  matrix  D  —  (d..)  with  d..  >  0,  such  that 
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(A. 2) 


Z  1  =  B'DB; 

see  e.g.  Graybill  [6],  Section  8.6;  B  is  "upper  triangular  of  type 

* 

r",  i.e.  b^_.  =  0  if  j-i  r.  Let  us  introduce  the  new  random  vector 
u  =  (u^, .  .  .  ,u^,)  '  ,  defined  by 

(A. 3)  u  =  By. 

Then  |u  =  0,  £uu’  =  BZB'  =  BB_1p_1B'_1B'  =  D_1,  and  the  u  'a  are 
uncorrelated.  From  (A. 3)  we  deduce  that 

(A.4)  ut  -  yt  +  btlyt+1  +•  •  •+ 

Solving  (A. 3)  for  y,  we  note  that  B  ^ 
triangular  and  hence 

(A.5)  yt  =  l  btSug5 

s=t 


t  =  1,2 , . . . ,T-r+l. 

ii 

=  (b  J)  is  also  upper 


t  =  1,2, ... ,T. 


From  Graybill  [6]  it  follows  that  there  exists  an  upper  triangular 
matrix  T  such  that  =  T  T.  Since  y~ ^  nnoin™ 


'ii 


4  0. 


Since  is  diagonal  of  type  r, 

of  type  r.  By  choosing  the  diagonal  matrix 
AT  =  B  .can  be  left  upper  triangular  of  type 
=  AA’  =  A2 ,  and  d±1  >  0. 


Then  D  1  = 


is  positive  definite, 

T  is  upper  triangular 
conveniently, 
and  with  b^  =  1. 
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Multiplying  (A. 4)  by  (A. 5)  with  t  replaced  by  t’,  t’  =  t+1 , . .  .  ,  T , 
and  taking  expected  values  we  have  that 


(A.  6) 


0  = 


att'+bti0t+i,t'+' 


•+b 


t,r-l°t+r-l,t' 


. »  _ 


=  t+1, . . . ,T, 


which  is  (A.l). 

Sufficiency.  We  have  to  show  that  if  (A.l)  holds,  w^_.  =  0  for 
|  i“j  |  r.  Consider  i  >  j,  that  is,  w^  is  below  the  main  diagonal. 
The  (T-l)  x  (T-l)  cofactor  of  o^  will  be  evaluated  by  Laplace's 
expansion  using  minors,  formed  by  its  last  T-r-j  columns.  For 
any  one  of  these  minors,  if  its  complementary  minor  does  not  include 
row  1  of  E,  then  the  first  r  columns  of  the  latter  are  linearly 
dependent.  If  row  1  of  E  is  included,  by  using  the  relation  (A.l) 
successively  and  at  most  j-1  times  the  complementary  minor  can  be 
brought  into  the  equivalent  form 


(A.  7) 


M 

-11 


-12 


M 

-22 


where  is  upper 

linearly  dependent. 

and  hence  w..  =  0. 

13 


triangular  and  the  first  r  columns  of  M£2  are 
In  either  case  the  complementary  minor  is  0 

Q.E.D. 
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Condition  (A.l)  states  the  existence  of  a  linear  relation 
between  successive  sets  of  r  adjacent  rows  of  E;  an  equivalent 
and  often  useful  formulation  is  to  relate  the  first  r-1  rows  to  each 
of  the  remaining  ones.  For  r  =  2  and  3  the  conditions  were 
written  explicitly  by  Greenberg  and  Sarhan  [7];  when  r  =  2  these 
reduce  to 


(A.  8) 


Zii.  * 

Gij 


i=2,3,...,T;  j  =  i  , i+1 , .  .  .  ,  T , 


where  of  course  we  require  the  relevant  components  in  the  first  row 
to  be  non-zero. 

As  an  application  of  (A. 8),  let  us  rederive  (3.20).  In  Section  3 
the  given  matrix,  E,  is  known  to  be  diagonal  of  type  r  =  2. 

From  (3.12)  we  know  that 

T+l 

x,  . 

(A. 9)  w±T  =  - 2T+Y"  (xl  “  xl1)’  1  = 

pCi-x.],  ) 


using  (3.19) 


T+l 


x. 


(A. 10) 


Wil  "  wT-i+l,T 


{ i  2T+2, 
pCl-x-j,  ) 


(X 


T-i+1 


-T+i-lv 

x,  ) , 


=  12  T 


By  symmetry  of  E  \  the  components  in  its  first  row  are 

xT+1 

(A.  11)  w  - - ^2t+2~  (xi_J+1  "  xiT+^_1)>  j  =  1,2,..., T. 

J  p  (l-Xj^  ) 
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The  proportionality  constants  are  obtained  from  (A. 9): 


(A.  12) 


WiT  X1  X1 
A  .  -  5 

1  w,_  -1 

1T  X1  “  X1 


i  =  2,3, ... ,T. 


Applying  these  to  (A. 11)  we  obtain 


(A. 13) 


w . 


p (x^-Xj1) CL-x2T+2) 


in, 


which  are  two  new  versions  of  (3.20). 
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